Optimizing Production Manufacturing Using Reinforcement Learning
نویسندگان
چکیده
Many industrial processes involve making parts with an assembly of machines, where each machine carries out an operation on a part, and the finished product requires a whole series of operations. A well-studied example of such a factory structure is the transfer line, which involves a sequence of machines. Optimizing transfer lines has been a subject of much study in the industrial engineering and operations research fields. A desirable goal of a lean manufacturing system is to maximize demand, while keeping inventory levels of unfinished product as low as possible. This problem is intractable since the number of states is usually very large, and the underlying models are stochastic. In this paper we present an artificial intelligence approach to optimization based on a simulation-based dynamic programming method called reinforcement learning. We describe a reinforcement learning algorithm called SMART, and compare its performance on optimizing manufacturing systems with that of standard heuristics used in industry.
منابع مشابه
A Greedy Divide-and-Conquer Approach to Optimizing Large Manufacturing Systems using Reinforcement Learning
Manufacturing is a challenging real-world domain for studying hierarchical MDP-based optimization algorithms. We have recently obtained very promising results using a hierarchical reinforcement learning based optimization algorithm for a 12-machine transfer line. Transfer lines model factory processes in automobile and many other product assembly plants. Unlike domains such as elevator scheduli...
متن کاملDecision Making in Agent-Based Manufacturing With A Reinforcement Learning Approach
Development of production systems, presents new ways of manufacturing. Agent-based systems are of emerging interest in the specification and implementation of manufacturing systems. In this paper, we have simulated a manufacturing system to introduce the role of intelligent decision making in manufacturing. The main idea is to develop independent agents which would create a formation for produc...
متن کاملA Reinforcement Learning Approach to Production Planning in the Fabrication/fulfillment Manufacturing Process
We have used Reinforcement Learning together with Monte Carlo simulation to solve a multi-period production planning problem in a two-stage hybrid manufacturing process (a combination of build-to-plan with build-to-order) with a capacity constraint. Our model minimizes inventory and penalty costs while considering real-world complexities such as different component types sharing the same manufa...
متن کاملManufacturing Scheduling Using Colored Petri Nets and Reinforcement Learning
Agent-based intelligent manufacturing control systems are capable to efficiently respond and adapt to environmental changes. Manufacturing system adaptation and evolution can be addressed with learning mechanisms that increase the intelligence of agents. In this paper a manufacturing scheduling method is presented based on Timed Colored Petri Nets (CTPNs) and reinforcement learning (RL). CTPNs ...
متن کاملA Reinforcement Learning Approach to Production Planning in the Fabricationeulfillment Manufacturing Process
We have used Reinforcement Learning together with Monte Carlo simnlation to solve a multi-period production planning problem in a westage hybrid manufacturing process (a combination of build-to-plan with build-to-order) with a capacity constraint. Our model minimizes inventory and penalty costs while considering real-world complexities such as different component types sharing the same manufact...
متن کامل